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Abstract 

In regression theory, it is stated that the disturbance term follows the normal distribution 
when the sample size is large. 

In Professor J. Johnston's words: "In view of the many factors involved, an appeal to 
the Central Limit Theorem would further suggest a normal distribution for «." [?] 

This paper includes an elementary proof that the disturbance term follows the normal 
distribution when n is large. 

Consider the regression equation 

Yi = a + fix* + Ui . 

The assumptions about the disturbance term Ui are summarized as follows: 

E{ Ui ) = 



E(uiUj) 



a 2 when i = j, i = 1, 2, 3, . . . , n 
when i ^ j, j = 1,2,3, ... ,n 



No assumption is made regarding the distribution of the disturbance term itj. We wish to 
show that for large n the term U{ follows the normal distribution J\f(0,a 2 ) with mean and 
variant a 2 . 

We proceed as follows: let 
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Then both the random variables X and Y approach the J\f(0, 1) distribution for large n. By 
the Central Limit Theorem: 
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and fy (y) = , — exp ( — — 



for large n. The joint density fxy(x, y) is completely determined if we can calculate the corre- 
lation pxy between X and Y. Thus we have: since ax = ay = \ 

cov(X, Y) 
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Thus the joint density fxy of X and Y is the bivariate normal density function: 



fxr(x,y) = 
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2n^l^ I 2(1 - p2 
with a x = 1, o y = 1, ^ = 0, ^ = 0, and p = ^ n 1} i 



x 2 - 2pxy + y 2 



is 



fxv{x,y) = 7J~~ ex p{ _ ^ ^nx 2 + 2^J n(n - l)xy + ny' 
for large n. 

In order to find the density of Uj for large n we consider the transformation (see [?, p. 204]): 
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Let the above transformation be a one-to-one transformation of the xy plane onto the uv plane 
with inverse transformation given by: 
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y = v. 



The Jacobian of the above transformation is: 
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We note in passing that the partial derivatives dx/dui, dx/du, dy/dui, and dy/du are all 
continuous functions of Ui and u as they are constant. 

We are interested in the absolute value of the Jacobian above: 
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Then the joint density of ui and v is 
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when v is large. 

Prom our study of the bivariate normal random variable u with density 




the integral above is unity i.e.: 

J-I^ eW { Z v} dV = 1 - 
So that the density of Uj alone is given by 

with u a normal distribution mean variance a 2 . 
This is what we set out to prove when n is large. 
Q.E.D. 



Note We observe that Ui and v are independent as their joint density factors out as a product 
of Ui and v alone. This is expected since Ui and 

n 

are clearly independent. 
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